Using Generalizability Theory to Develop Clinical Assessment Protocols

Comment: Generalizability theory and assessment in medical training.

Generalizability theory and assessment in medical training Even though it is more than 50 years old, generalizability theory, or G theory, is not well known to the medical community. It combines aspects of classic test theory and analysis of variance in order to estimate reliability (“G-study”) of a measurement instrument as a function of design aspects (“facets” in G-theory literature), and to...

Reliability of a viva assessment of clinical reasoning in an Australian pre-professional osteopathy program assessed using generalizability theory

Clinical reasoning is situation-dependent and case-specific; therefore, assessments incorporating different patient presentations are warranted. The present study aimed to determine the reliability of a multi-station case-based viva assessment of clinical reasoning in an Australian pre-registration osteopathy program using generalizability theory. Students (from years 4 and 5) and examiners wer...

Generalizability Theory: Overview

36 Generalizability Theory

Generalizability (G) theory is a statistical theory for evaluating the dependability (or reliability) of behavioral measurements (Cronbach, Gleser, Nanda, & Rajaratnam, 1972; see also Brennan, 2001; Shavelson & Webb, 1991). G theory permits the researcher to address such questions as: Is the sampling of tasks or judges the major source of measurement error? Can I improve the reliability of the ...

Clinical assessment of transthoracic echocardiography skills: a generalizability study

BACKGROUND Transthoracic echocardiography (TTE) is a widely used cardiac imaging technique that all cardiologists should be able to perform competently. Traditionally, TTE competence has been assessed by unstructured observation or in test situations separated from daily clinical practice. An instrument for assessment of clinical TTE technical proficiency including a global rating score and a c...